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We  consider  the  problem  of  bounding  the  expected  value  of  a  linear  program  (LP)  containing  random  coefficients,  with  applications  to 
solving  two-stage  stochastic  programs.  An  upper  bound  for  minimizations  is  derived  from  a  restriction  of  an  equivalent,  penalty-based 
formulation  of  the  primal  stochastic  LP,  and  a  lower  bound  is  obtained  from  a  restriction  of  a  reformulation  of  the  dual.  Our  “restricted- 
recourse  bounds”  are  more  general  and  more  easily  computed  than  most  other  bounds  because  random  coefficients  may  appear  anywhere 
in  the  LP,  neither  independence  nor  boundedness  of  the  coefficients  is  needed,  and  the  bound  is  computed  by  solving  a  single  LP  or 
nonlinear  program.  Analytical  examples  demonstrate  that  the  new  bounds  can  be  stronger  than  complementary  Jensen  bounds.  (An  upper 
bound  is  “complementary”  to  a  lower  bound,  and  vice  versa).  In  computational  work,  we  apply  the  bounds  to  a  two-stage  stochastic 
program  for  semiconductor  manufacturing  with  uncertain  demand  and  production  rates. 


This  paper  develops  new  techniques  for  bounding  the 
expected  value  of  a  stochastic  linear  program,  which 
is  a  linear  program  (LP),  some  or  all  of  whose  coefficients 
are  random.  The  random  coefficients  may  be  discretely  or 
continuously  distributed,  may  be  independent  or  contain  de¬ 
pendencies,  and  may  occur  anywhere  in  the  objective  func¬ 
tion,  right-hand  side,  or  constraint  matrix.  Calculating  (or 
estimating)  the  expected  value  of  a  stochastic  LP  is  key  to 
solving  two-stage  and  multi-stage  stochastic  programs  with 
recourse  (Dantzig  1955). 

It  is  usually  impossible  to  compute  exactly  the  expected 
value  of  a  stochastic  LP  unless  the  random  coefficients  are 
discretely  distributed  and  the  total  number  of  realizations 
of  the  coefficients  is  small,  or  the  problem  has  a  very  spe¬ 
cial  structure.  As  a  result,  solution  techniques  for  stochastic 
programming  with  recourse  usually  involve  approximations 
that  are  based  on  Monte  Carlo  sampling  (e.g.,  Ermoliev 
1983,  Dantzig  and  Glynn  1990,  Higle  and  Sen  1991)  or  on 
deterministically  valid  boimds.  This  paper  involves  approx¬ 
imations  of  the  latter  type. 

When  initial  lower  and  upper  bounds  are  insufficiently 
tight,  they  can  often  be  improved  within  a  sequential- 
approximation  algorithm  that  iteratively  partitions  the  sup¬ 
port  of  the  random  variables  (e.g.,  Kail  et  al.  1988).  We  do 
not  discuss  the  details  of  these  algorithms  here,  but  note  that 
our  restricted-recourse  bounds  can  be  incorporated  within 
such  algorithms  just  as  well  as  other  bounds  can,  and  pos¬ 
sibly  better  because  of  improved  computational  efficiency 
and  fewer  technical  requirements. 

The  problem  of  computing  the  expected  value  of  a 
stochastic  LP  also  arises  as  a  stand-alone  problem.  For  in¬ 
stance,  the  stochastic  maximum-flow  problem  (e.g.,  Evans 


1976)  calculates  the  expected  value  of  the  maximum  flow 
through  a  network  whose  arc  capacities  are  nonnegative 
random  variables.  Another  example  is  the  stochastic  PERT 
problem  (Fulkerson  1962),  which  evaluates  the  expected 
length  of  a  longest  path  in  a  directed  acyclic  network 
with  stochastic  arc  lengths.  Both  of  these  problems  can 
also  appear  as  second-stage  recourse  problems  in  two- 
stage  stochastic  programs  with  recourse.  In  the  former 
case,  first-stage  decisions  make  resource-constrained  in¬ 
vestments  in  arc  capacities;  the  problem  is  to  maximize  the 
expected  value  of  the  second-stage  recourse  function,  i.e., 
the  expected  value  of  the  maximum  flow  (Wallace  1987a, 
Wollmer  1991).  In  the  latter  case,  recourse-constrained 
investments  reduce  the  (expected)  lengths  of  certain  arcs 
for  the  purpose  of  minimizing  the  expected  length  of  a 
maximum-length  path  (Wollmer  1985). 

Stochastic-programming  formulations  are  used  to  model 
many  real-world  planning  problems  that  are  similar  to,  but 
more  complex  than  the  simple  network  problems  just  de¬ 
scribed:  The  structure  of  the  constraints  is  usually  more 
involved,  and  random  coefficients  may  occur  anywhere  in 
the  objective,  right-hand,  side  or  constraint  matrix.  Appfica- 
tions  include  capacity-expansion  planning  in  electric  power 
systems  (Dantzig  et  al.  1989)  and  the  telecommimications 
industry  (Sen  et  al.  1994),  finance  (Carino  et  al.  1994), 
hydroelectric  scheduling  (Jacobs  et  al.  1995),  forest  har¬ 
vest  management  (Gassmann  1989),  and  vehicle  allocation 
(Powell  1986).  We  regard  the  bounds  developed  in  this 
paper  as  tools  with  potential  for  significantly  increasing 
the  applicability  of  sequential-approximation  methods  for 
solving  both  the  simple  and  complex  problems  mentioned 
above. 
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Deterministic  bounds  for  stochastic  LPs  may  be  derived 
either  from  functional  approximations  of  the  recourse  func¬ 
tion  or  from  approximations  of  the  probability  distribution 
that  governs  the  random  parameters.  The  most  widely  known 
bound  is  based  on  Jensen’s  inequality  for  convex  functions 
and,  interestingly,  this  bound  can  be  derived  from  either  type 
of  approximation  (e.g..  Kail  and  Wallace  1994,  §3.4).  The 
bound  is  easy  to  compute — the  recourse  function  is  evalu¬ 
ated  once  at  the  mean  of  the  random  parameters — ^but  the 
requirement  for  convexity  (or  concavity)  limits  its  applica¬ 
bility. 

Piecewise-linear  bounds  (Birge  and  Wallace  1988,  Wal¬ 
lace  1987b,  Birge  and  Wets  1986,  Birge  and  Wets  1989) 
are  based  on  a  functional  approximation.  These  bounds  can 
be  computed  by  solving  a  sequence  of  restrictions  of  the  re¬ 
course  problem  and  thus  yield  upper  bounds  for  a  minimiza¬ 
tion  problem  (Birge  and  Wallace  1988).  For  the  purpose  of 
solving  stochastic  LPs,  it  is  significant  that  the  piecewise- 
linear  bound  is  complementary  to  the  Jensen  boimd.  That  is, 
when  Jensen’s  inequality  may  be  applied  to  yield  a  lower 
bound,  the  piecewise-linear  boimd  is  an  upper  bound  and 
vice  versa.  The  bounds  are  derived  from  a  separable  ap¬ 
proximation  of  the  recourse  function  that  contains  a  sum  of 
r  one-dimensional  expectations,  where  r  is  the  number  of 
stochastic  parameters.  Bounds  with  this  structure  typically 
can  be  applied  to  problems  with  random  parameters  that 
have  bounded  or  unbounded  support.  The  bounds  are  rela¬ 
tively  easy  to  compute — they  require  (9{r  )  solutions  of  the 
recourse  problem — ^but  they  are  effectively  limited  to  prob¬ 
lems  with  stochastic  right-hand  sides  only.  Other  examples 
of  bounds  based  on  functional  approximations  can  be  found 
in  Birge  (1985),  Edirisinghe  and  Ziemba  ( 1 992 ),  and  Powell 
and  Frantzeskakis  (1994).  We  discuss  these  in  more  detail 
after  looking  at  distributional  approximations. 

Bounds  derived  from  distributional  approximations  are 
exemplified  by  the  Edmundson-Madansky  (E-M)  bound 
(Edmundson  i956,  Madansky  1959)  and  its  generaliza¬ 
tions.  The  E-M  bound  is  constructed  by  replacing  the 
original  probability  distribution  with  an  approximating  dis¬ 
tribution  that  has  mass  only  at  the  extreme  points  of  the 
random  parameters’  support.  This  bound  can  be  stronger 
than  alternatives  such  as  the  piecewise-linear  bound 
(Wallace  1987b,  Birge  and  Wallace  1988),  but  it  has  sig¬ 
nificant  drawbacks:  (a)  The  random  parameters  must  be 
independent  and  bounded,  (b)  the  recourse  function  must 
be  convex  or  concave,  and  (c)  the  recourse  function  must 
be  evaluated  &{2'')  times.  Gassmann  and  Ziemba  (1986) 
generalize  the  E-M  bound  to  dependent  random  variables 
defined  on  polyhedral  sets  that  need  not  be  bounded.  Frauen- 
dorfer  (1988)  generalizes  the  E-M  bound  for  dependent 
random  variables  defined  on  (multidimensional)  rectangles 
by  incorporating  cross-moment  information. 

Frauendorfer  (1992)  develops  a  sequential-approximation 
algorithm  that  may  avoid  the  exponential  effort  normally 
required  for  bound  computation  by  applying  the  bounds  on 
a  Cartesian  product  of  simplices.  The  approach  is  applicable 
to  LPs  with  possibly  dependent  stochastic  right-hand  sides 


and  objectives.  Edirisinghe  and  Ziemba  (1994a,  1994b) 
extend  the  bounds  to  the  convex-concave  case  by  applying 
them  over  more  general,  possibly  unbounded,  polyhedra. 
Edirisinghe  (1996)  and  Edirisinghe  and  You  (1996)  de¬ 
velop  distributional  bounds  on  simplices  and  show  how  to 
tighten  these  bounds  by  using  second-order  information  and 
by  using  simplices  with  least  possible  volume.  See  Dula 
(1992)  for  related  work  using  a  functional  approximation. 

Conditional  probability  mass  and  moment  calculations — 
these  are  required  in  a  sequential-approximation  algorithm — 
can  be  difficult  when  distributional  bounds  are  applied 
on  simplices  or  more  general  polyhedra  that  are  “un¬ 
natural”  with  respect  to  the  underlying  probability  model. 
It  is  possible  to  circumvent  these  difficulties  (Edirisinghe 
1996,  Edirisinghe  and  You  1996,  Frauendorfer  1992)  by 
generating  manageable  numbers  of  scenarios  via  Monte 
Carlo  sampling  and  by  applying  the  bounds  to  the  resulting 
empirical  model  rather  than  the  original  model.  For  large 
sample  sizes,  this  approach  is  justified  by  the  theory  of 
epi-convergence  (King  and  Wets  1991). 

We  note  that  several  of  the  extensions  of  the  Jensen  and 
E-M  bounds,  as  well  as  some  bounds  based  on  functional 
approximations  (e.g.,  Birge  and  Dula  1991,  Birge  and  Wets 
1986)  may  be  derived  in  an  alternative  manner — in  partic¬ 
ular,  as  solutions  of  generalized  moment  problems  (Birge 
and  Wets  1987;  Kail  1988;  Frauendorfer  1992;  Edirisinghe 
and  Ziemba  1994a,  1994b).  This  interpretation  of  bounds 
for  stochastic  programs  begins  with  the  work  of  Dupacova 
in  a  game-theoretic  setting  (Zackova  1966)  and  also  has  ap¬ 
plications  in  models  with  incomplete  information  regarding 
the  probability  distribution  (Dupacova  1994). 

The  restricted-recourse  bounds  proposed  in  this  paper  are 
attractive  because  they:  (a)  are  relatively  easy  to  compute, 
(b)  are  deterministically  valid,  (c)  have  no  restrictions  as  to 
where  random  coefficients  may  occur  in  the  problem,  and 
(d)  are  computable  for  random  coefficients  with  bounded  or 
unbounded  ranges.  In  order  to  apply  the  restricted-recourse 
methodology,  we  require  that  bounds  on  optimal  dual  vari¬ 
ables  (for  the  primal  bound)  or  primal  variables  (for  the 
dual  bound)  of  the  recourse  problem  be  specified.  In  prac¬ 
tice,  specifying  bounds  on  primal  variables  is  usually  simple, 
and  models  that  contain  explicit  penalties  for  constraint  vio¬ 
lations  automatically  incorporate  bounds  on  dual  variables. 
We  will  illustrate  that  special  structures  may  be  exploited  to 
derive  appropriate  dual  bounds  in  many  of  the  cases,  too. 

The  restricted-recourse  bounds  in  this  paper  may  be 
viewed  as  improvements  on  the  penalty-based  “aggrega¬ 
tion  bounds”  developed  by  Birge  (1985)  for  stochastic 
LPs  and  by  Edirisinghe  and  Ziemba  (1992)  for  two-stage 
stochastic  (convex)  programs.  The  aggregation  bounds  are 
based  on  functional  approximations  for  recourse  problems 
that  have  explicit  penalties  for  constraint  violations  and 
that  have  random  coefficients  in  the  right-hand  side  only. 
With  this  structure,  the  expected  value  of  the  penalty  term 
separates  into  a  sum  of  one-dimensional  expectations  that 
is  computed  for  fixed  first-  and  second-stage  decision  vari¬ 
ables.  Because  the  bounds  are  based  on  restrictions,  they 
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are  upper  (lower)  bounds  for  minimization  (maximization) 
problems. 

Powell  and  Frantzeskakis  (1994)  first  use  the  term  “re¬ 
stricted  recourse”  for  bounding  two-stage  (and  multi-stage) 
network  recourse  problems;  their  scope  is  limited  to  net¬ 
work  models  with  stochastic  right-hand  sides  and  constraint- 
violation  penalties.  Like  aggregation  bounds,  their  methods 
lead  to  separable  approximations  of  the  recourse  function. 
An  important  difference  is  that  for  any  first-stage  decision, 
Powell  and  Frantzeskakis  compute  the  expected  cost  of  a 
single  best  second-stage  decision,  and  they  minimize  this 
expected  cost  over  all  first-stage  decisions.  As  a  result,  this 
model  is  less  restricted  than  that  employed  by  aggregation 
bounds,  and  tighter  bounds  can  be  obtained.  (We  note  also 
that  Vladimirou  and  Zenios  (1997)  use  “restricted  recourse” 
to  refer  to  a  class  of  models  designed  to  control  the  vari¬ 
ability  of  recourse  decisions  in  two-stage  stochastic  linear 
programs.) 

Om  restricted-recourse  bounds  substantially  generalize 
the  bounds  of  Powell  and  Frantzeskakis  because  (a)  our 
bounds  are  applicable  to  general  LPs,  (b)  random  coeffi¬ 
cients  may  occur  anywhere  in  the  problem,  and  (c)  we  de¬ 
scribe  both  primal  and  dual  hounds. 

Our  first  application  of  the  generalized  version  of 
restricted-recourse  was  to  a  stochastic  network-interdiction 
problem  (Cormican  et  al.  1996).  We  solve  that  problem 
using  a  sequential-approximation  algorithm  that  incorpo¬ 
rates  a  Jensen  upper  bound  and  a  restricted-recourse  lower 
bound.  Restricted  recourse  was  not  explicitly  used  to  derive 
the  bound,  however,  because  a  reformulation  and  an  appli¬ 
cation  of  Jensen’s  inequality  to  that  reformulation  suffices. 
Nonetheless,  the  current  paper  generalizes  the  basic  tech¬ 
nique;  If  bounds  on  optimal  dual  variables  are  available, 
we  show  that  any  stochastic  LP  can  be  converted  to  an 
equivalent  problem  with  a  stochastic  objective  function  but 
deterministic  constraints.  By  solving  a  restriction  of  the  re¬ 
formulation  in  which  a  single  recourse  decision  is  allowed, 
an  upper  (lower)  boimd  results  when  the  original  problem 
is  a  minimization  (maximization).  We  classify  this  bound 
as  a  primal  restricted-recourse  bound.  Evaluation  of  the 
bound  is  equivalent  to  solving  a  stochastic  program  with 
simple  recourse  (Beale  1955,  Wets  1966),  so  computational 
issues  are  already  well  studied. 

Our  technique  works  in  the  other  direction,  too.  By  first 
taking  the  dual  of  the  recourse  LP  and  then  applying  the 
new  bounding  methodology,  we  achieve  a  lower  (upper) 
bound  when  the  primal  problem  is  a  minimization  (max¬ 
imization).  This  result  is  derived  using  a  restricted  dual 
problem,  so  it  is  a  dual  restricted-recourse  bound.  Because 
the  primal  construction  yields  one  bound  and  the  dual  con¬ 
struction  yields  a  complementary  bound,  our  techniques 
give  us  the  important  ability  to  obtain  both  lower  and  upper 
bounds  on  a  problem  when  other  bounds  are  inapplicable 
or  are  more  difficult  to  use. 

Like  other  functional  approximations,  our  method  bounds 
an  r-dimensional  expectation  by  a  sum  of  lower-dimensional 
expectations.  For  example,  if  each  constraint  contains  at 


most  one  random  parameter  the  primal  restricted-recourse 
boimd  optimizes  a  sum  of  one-dimensional  expectations  that 
involve  only  the  random  parameters’  marginal  distributions. 
This  is  an  advantage  because  the  bounds  are  much  easier  to 
calculate  than  the  original  higher  dimensional  expectation, 
and  the  bounds  are  valid  for  dependent  as  well  as  indepen¬ 
dent  random  parameters.  That  certain  dependencies  are  not 
captured  is  a  disadvantage  because  it  can  weaken  the  bounds. 

The  rest  of  the  paper  is  outlined  as  follows.  In  §1,  we 
develop  primal  restricted-recourse  bounds  for  general,  two- 
stage  stochastic-programming  problems.  We  then  show 
how  the  primal  bounding  models  vary  and  can  be  simpli¬ 
fied  depending  on  the  location  of  random  coefficients  in  the 
model,  and  whether  the  random  coefficients  are  discretely 
or  continuously  distributed.  Also,  for  some  simple  network 
examples  with  stochastic  right-hand  sides,  we  show 
analytically  that  our  bound  can  be  tighter  than  the  com¬ 
plementary  Jensen  bound.  Section  2  develops  the  dual 
restricted-recourse  bound,  shows  various  bounding  models, 
and  analyzes  some  network  examples,  all  analogous  to  §1. 
Section  3  gives  computational  results  for  our  bounds  ap¬ 
plied  to  a  semiconductor  manufacturing  problem.  Section  4 
gives  conclusions  and  directions  for  further  research. 

1.  A  PRIMAL  RESTRICTED-RECOURSE  BOUND 
FOR  STOCHASTIC  LPs 
1.1.  Preliminaries 

A  two-stage  stochastic  LP  with  recourse  may  be  written  as 
SLP-2  mincx -b  £'/!(x,  ^), 

where 

hlpL,  I)  =  minfy 
yer 

s.t.  .Dy  ^Sx  +  d. 

X  is  a  polyhedral  set  and  |  =  vec(d,  f,  BD),  where  the 
“vec”  operator  reads  its  arguments  columnwise  to  form  a 
single  vector.  The  random  vector  |  is  defined  on  a  proba¬ 
bility  space  (ff,  J^,  ^)  with  a  generic  realization  denoted 
Deterministic  linear  constrains  on  y  are  represented  by 
y  €  F;  these  normally  include,  at  least,  the  nonnegativity 
restrictions  y  ^  0. 

One  motivation  for  the  bounding  techniques  described  in 
this  paper  is  to  aid  in  the  solution  of  problems  of  the  form  of 
SLP-2.  However,  for  ease  of  presentation,  we  assume  that 
the  first-stage  decision  vector  x  is  fixed  and  focus  on  bound¬ 
ing  the  expected  value  of  the  redefined  recourse  function 

RFO  /2o(?)  =  min  fy 

yer 

s.t.  Dy  ^d. 

We  have  suppressed  the  fixed  first-stage  decision  in  RFO, 
absorbed  the  entire  right-hand  side  in  d,  and  redefined  |  to 
be  I  =  vec(d,  f,  D).  We  will  refer  to  RFO  as  “the  second 
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stage”  and  call  y  “second-stage  variables,”  but  it  should  be 
clear  that  RFO  also  represents  stand-alone  stochastic  LPs 
such  as  the  stochastic  maximum-flow  and  stochastic  PERT 
problems  described  in  the  introduction.  We  use  only 
constraints  in  developing  our  initial  bound  for  RFO,  but  any 
combination  of  inequalities  and  equalities  may  be  used;  see 
§1.2.  By  convention,  matrix  D  has  m  rows  and  n  columns, 
and  the  remaining  matrices  and  vectors  are  dimensioned  to 
conform.  Throughout  this  paper  we  assume  that  first  moment 
of  I  is  finite. 

The  restricted-recourse  boimd  we  develop  is  based  on  two 
results  contained  in  Lemmas  1  and  2  below. 

Lemma  1  (Madansky  1960).  Let  h(^)  =  minygy  r(y, 
where  v{y,  is  a  real-valued  function.  Then 

Eh(^)  =  E  min  r(y,  |)  ^  min  Ev{y,  ^). 
yer  yer 

Lemma  2.  Suppose  that  the  following  LP  has  a  finite  opti¬ 
mal  solution: 

LPO  zo  =  min  fy 

y3>o 

s.t.  Dy^d  :  n 
Hy^h  :  y, 

where  n  and  y  are  dual  variables  for  the  indicated  con¬ 
straints.  Let  n"  he  a  vector  of  upper  hounds  on  n*  for  some 

(n*,  y*)  G  argmax  |7id  -I-  yh|. 

n^o,y^Q 

Also,  let 

LPl  =  min  fy  -|-  7i"(d  —  Dy)^, 
yer 

where  7  =  {y  :  Hy^h,  y^O},  and  where  (d  —  Dy)^  is 
the  positive  part  of  (d  —  Dy),  i.e.,  the  vector  of  constraint 
violations  of  Dy^A.  Then,  Zq  =  zj". 

Proof.  The  dual  of  LPO  is 
DPO  Zn  =  max  ;td  +yh 

ji^O.ySsO 

s.t.  nD  -\-yH  ^  f . 

By  hypothesis,  we  may  add  the  upper  boimds  n"  ^  n  without 
changing  the  optimal  solution  value  to  DPO.  Therefore,  the 
following  LP  is  equivalent  to  DPO: 

DPOa  zn  =  max  Tid  +  yh 

ji^O.ySsO 

s.t.  nD  -f  yH  ^  f 

n^n" . 

The  dual  of  DPOa  is  LPl,  so  zj  =  (Expand  LPl  into 
the  form  of  a  standard  LP. )  □ 

Lemma  1  is  the  “wait-and-see”  bound  of  Madansky 
(1960)  and  follows  directly  from  exchanging  the  order  of 
expectation  and  optimization.  This  bound  can  be  applied 


to  SLP-2  to  obtain  a  lower  bound  by  allowing  first- stage 
decisions  to  adapt  artificially  to  every  realization  of  the 
second  stage.  This  is  a  relaxation  of  the  original  problem 
and  hence  yields  a  lower  boimd.  However,  we  will  apply  it 
to  the  second-stage  problem  to  obtain  an  upper  bound  by 
insisting  that  only  one  second-stage  decision  be  employed 
for  all  realizations.  This  is  a  restriction  and  hence  leads  to 
an  upper  bound. 

Lemma  2  is  related  to  results  on  exact  penalty  func¬ 
tions  for  nonlinear  programs  (Zangwill  1967)  and  aggrega¬ 
tion  bounds  for  linear  programs  (Zipkin  1980).  This  lemma 
allows  us  to  restate  the  primal  stochastic  LP  using  an  equiv¬ 
alent  penalty-based  formulation  of  the  problem.  Then  we 
apply  restricted  recourse.  Lemma  1,  to  the  reformulation  to 
obtain  an  upper  bound.  Bounds  on  dual  variables  will  some¬ 
times  be  difficult  to  obtain,  but  often  will  not.  For  instance, 
an  elastic  LP  has  explicit  penalties  n  for  violating  constraints 
and  these  penalties  are  upper  bounds  on  n. 

1.2.  The  Primal  Bound 

Here  we  derive  the  primal  restricted-recourse  bound. 

Theorem  1.  Let  ^  =  vec(d,  f,  D)  and 
RFO  half)  =  min  fy 

yer 

s.t.  Dy  :  n(^). 

Let  n"  ^n*{^),  wpl  ( with  probability  1 ),  where  n*(^)  de¬ 
notes  the  appropriate  subvector  of  an  optimal  solution  to 
the  dual  o/RFO.  Then,  h'^^Ehof^)  where 

NLPl  h%  =  min  jEf  |y  +  n'E\{A  -  .Dy)+]. 

yer 

Proof.  Let  =  min  fy  -b  7i"(d  —  Dy)^.  Then 
yer 

Eho(^)  =  Eh.^(^)  by  Lemma  2 

^  min  Lffy  -b  7t"(d  —  .Dy)+]  by  Lemma  1 

yer 

=  min  [iifjy -b  7i"£'[(d  —  Dy)+].  □ 

yer 

The  subscript  is  used  because  this  is  the  “primal 
restricted  bound”;  the  dual  restricted  bound  (§2)  will  be 
indicated  with  a  subscript.  Of  course,  we  need  to  de¬ 
scribe  the  linear  and  nonlinear  models  that  are  required  to 
compute  the  bound  proposed  in  Theorem  1.  Before  doing 
that,  however,  we  wish  to  point  out  some  important  features 
of  the  preceding  result. 

Remark  1.  Unlike  many  other  bounds,  the  primal  restricted- 
recourse  bound  does  not  require  convexity,  concavity,  or 
saddle-function  properties  of  the  recourse  function  ho{^). 

Remark  2.  Finding  good  bounds  on  optimal  dual  variables 
is  key  to  the  quality  of  the  proposed  bound.  Special  struc¬ 
tures  provided  by  network  models,  or  elastic  formulations  of 


Morton  and  Wood  /  947 


more  general  models,  often  enable  one  to  state  such  bounds 
a  priori.  Sections  1 .4  and  3  illustrate  how  these  dual  bounds 
may  be  derived  and  improved  upon. 

Remark  3.  If  RFO  is  reformulated  as  an  elastic  model  that 
includes  explicit  penalties  n  for  violating  constraints,  The¬ 
orem  1  follows  with  n"  =  n  because  ii  is  an  explicit  vector 
of  upper  boimds  on  Such  explicit  penalties  also  al¬ 

low  Theorem  1  to  be  generalized  to  models  in  which  the 
variables  y  are  restricted  to  be  integers. 

Remark  4.  Theorem  1  adapts  to  any  standard  constraint 
type,  not  just  the  “  ^  ”  constraints  of  the  canonical  LPO/RFO 
formulation.  For  example. 


E 


min 

yer 

s.t. 


fy 

^y  =  d 


^  min  [.Ef]y  -b  n"E[{A  -  .Dy)+]  -  n'E[{by  -  d)+], 

yer 


provided  ti' wp\,  where  is  an  optimal 

dual  vector  associated  with  constraints  Dy  =  d  for  |  = 
vec(d,  f,  b). 

Remark  5.  NLPl  is  a  stochastic  program  with  simple  re¬ 
course  (Wets  1966,  Ziemba  1974,  Wets  1983),  which, 
because  of  its  special  structure,  can  be  solved  with  compu¬ 
tational  ease  compared  to  stochastic  programs  with  general 
recourse. 

In  the  next  section,  we  describe  the  models  that  must 
be  solved  to  compute  the  primal  restricted-recourse  bound. 
These  models  vary  depending  on  whether  the  random  coeffi¬ 
cients  are  continuous  or  discrete,  and  become  simpler  when 
only  certain  subsets  of  these  coefficients  are,  in  fact,  random. 

1.3.  Models  for  Computing  the  Primal  Bound 

1.3.1.  Discrete  Random  Variables.  When  b  and  d  are 

discrete  random  variables  that  take  on  a  finite  number 
of  values — ^the  form  of  f  is  important  only  through  its 
mean — ^NLPl  can  be  solved  as  a  finite  linear  program.  Let 
the  rth  realization  of  the  row  vector  (D,.,  dt)  be  denoted 
(f;),  let  the  set  R,  index  these  realizations,  and  let 
=  R[(A.,  di)  =  (Dj.,  c/[)].  NLPl  can  now  be  written  as 


becomes 


mm  cx  -|-[iif]y -f  TtiAz, 

xeA;yer,z>o  ^ 

i=l  r^Ri 


s.t.  — Rj'.x  -bAy  +2^  ^d%  i  =  ,  m,  r  €  Ri, 


where  the  rth  realization  of  the  vector  (/),.,  S,.,  j,  )  is 
(A,  A,  d''j),  Ri  indexes  these  realizations,  and  p]  = 
R[((A-,  Ao  di)  =  (A,  A,  A)]-  Some  alternative  bounds 
from  the  literature  can  be  calculated  only  with  fixed  first- 
stage  variables  x;  restricted-recourse  boimds  could  be  com¬ 
puted  for  fixed  x,  but  we  see  that  a  tighter  bound  may  be 
obtained  by  optimizing  the  bounding  model  with  respect 
to  X. 

Now  we  consider  the  size  of  LPla.  For  simplicity,  as¬ 
sume  that  Y  consists  only  of  nonnegativity  constraints.  Note 
that  the  number  of  structural  constraints  in  the  dual  of  LPla 
is  n,  the  dimension  of  y,  and  does  not  depend  on  the  number 
of  realizations.  Thus,  it  may  be  desirable  to  solve  the  dual 
or  apply  the  dual  simplex  method  (Ziemba  1974,  §6).  The 
number  of  dual  decision  variables  is  A' I  hence 
can  be  large.  However,  the  size  of  this  program  typically 
is  much  smaller  than  the  size  of  the  deterministic  equiva¬ 
lent  of  the  corresponding  SLP-2  model  because  the  num¬ 
ber  of  constraints  and  variables  in  that  problem  depends  on 

nti  iAi. 

LPla  may  be  of  reasonable  size  for  many  models.  For 
example,  consider  a  generalized  network  with  random  gains 
and  losses  on  arc  flows  such  as  those  used  in  certain  financial 
models  (e.g.,  Mulvey  and  Vladimirou  1 989).  in  a  model  with 
(a)  random  returns  on  asset  i  from  a  previous  period,  (b) 
a  random  conversion  coefficient  for  cash  to  the  number  of 
units  of  asset  i,  and  (c)  deterministic  exogenous  inflow  into 
the  associated  node,  the  number  of  stochastic  parameters  in 
(D,.,  di. )  is  two.  As  a  result  of  this  low  dimension,  A'  I 
can  be  modest:  if  each  random  coefficient  can  take  on  k 
different  values  and  the  original  LP  has  m  rows,  LPla  will 
have  mk^  rows,  whereas  the  deterministic  equivalent  would 
have  wjA”  second-stage  rows. 

When  the  recourse  matrix  D  is  deterministic,  we  have  a 
stochastic  program  with  fixed  recourse  (Wets  1974),  and 
|R,j  depends  only  on  the  number  of  possible  outcomes  of 
di.  For  this  case,  LPla  simplifies  to 


LPla  min  [£’f]y  +  >  >  n  p^iz\ 

VGy,z>0  t  ri  I 


"  r 
Jl 

1-1  r^Ri 

s.t.  Ay+A^A>  i  =  r  &  Ri. 


LPlb  min  [iifjy -f  y^  y^  n" p’iz’i 

yer.zSsO  i  I 

1=1  r^Ri 


s.t. 


Ay  +A  ^d\,  i  =  I,...,  m,  r  e  Ri, 


Before  looking  more  closely  at  LPla,  it  is  important  to 
note  that  no  generality  is  lost  by  ignoring  first-stage  vari¬ 
ables  in  these  discrete  models.  If  B  of  SLP-2  has  discretely 
distributed  random  coefficients  with  a  finite  number  of 
realizations,  the  upper-bounding  model  for  SLP-2  simply 


where  A  =  P[di  = 

LPlb  can  be  further  simplified.  Suppose  that  each  can 
take  on  the  values  dj  <  d}  <  ■  ■  ■  <  for  notational 
simplicity,  assume  that  Dy  ^  0  for  all  y  e  F,  d\  >  0,  and 
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define  =  0-  With  =  P[di^d'^]  LPlb  simplifies  to 

m 

LPlc  min  [£f]y  +  ^  ^  O/zf 

i=\  r^Ri 

s.t.  A-.y  +  X! i  =  1, ■  ■  ■ ,  ffj, 

r^Ri 

0^z[  —  Jp',  i  =  I,...,  m,  r  G  Ri. 

Therefore,  when  the  right-hand-side  d  of  the  stochastic  re¬ 
course  function  consists  of  discrete  random  variables,  and 
D  is  deterministic,  our  hounding  LP,  LPlc,  may  be  only 
modestly  larger  than  the  “original”  deterministic  LP,  i.e., 
the  stochastic  LP  with  the  random  vector  d  replaced  by  a 
deterministic  vector  d.  In  particular,  the  bounding  LP  will 
have  the  same  number  of  structural  constraints  as  the  orig¬ 
inal  LP  and  will  include  the  original  structural  variables  y, 
but  will  have  an  additional  set  of  I^'  I  bounded  arti¬ 
ficial  variables  representing  possible  constraint  violations. 
For  solving  this  problem,  Wets  (1983)  describes  an  efficient 
variant  of  the  simplex  method  that  exploits  the  piecewise- 
linear  convex  functions  modeled  with  the  terms  YreR 
He  reports  that  the  solution  times  for  such  an  algorithm  are 
only  “marginally  greater”  than  the  times  required  to  solve 
the  same  LPs  with  each  summation  replaced  by  a  single  vari¬ 
able.  For  example,  for  an  application  in  finance,  Kusy  and 
Ziemba  (1986)  foimd  the  simple-recourse  model’s  solution 
times  to  be  “. . .  1.5-2  times  that  of  a  related  deterministic 
model . . . .” 

When  attempting  to  solve  two-stage  programs  by  utilizing 
LPlc,  ordering  the  realizations  of  may  not  be  possible  if 
d  depends  on  x  and  we  attempt  to  simultaneously  optimize 
over  X  and  y.  However,  in  some  models,  second-stage  con¬ 
straints  contain  random  right-hand  sides  that  are  separate 
from  those  containing  first-stage  decision  variables,  and  this 
issue  does  not  arise.  This  is  illustrated  in  the  computational 
example  of  §3. 

Finally,  we  note  that  when  both  D  and  d  are  determinis¬ 
tic  vectors,  our  bound  reduces  to  the  standard  Jensen  bound 
for  a  stochastic  LP  with  a  stochastic  objective  function 

fy 

1.3.2  Continuous  Random  Variables.  When  D  and  d  both 
contain  continuous  random  variables  (again  f  is  unimpor¬ 
tant),  using  Theorem  1  to  compute  a  bound  may  be  difficult 
because  computing  expected  constraint  violations  can  in¬ 
volve  convolutions  of  random  variables  whose  weights,  via 
the  decision  variables  y,  are  not  known  a  priori.  However, 
when  d  is  continuously  distributed,  and  D  is  deterministie 
(and  in  the  case  of  two-stage  models,  B  is  deterministic), 
NLPl  may  be  solved  efficiently  because  the  objeetive  is  just 
a  sum  of  one-dimensional  integrals.  For  instance,  when  each 
di  is  uniformly  distributed,  the  bounding  model  will  be  a  sep¬ 
arable  quadratie  program.  This  was  shown  by  Beale  (1961) 
in  the  context  of  stochastic  programs  with  simple  recourse 
and  is  illustrated  by  a  simple  example  in  the  next  seetion. 
Wets  (1966)  shows  that  when  di  is  an  exponential  random 


variable,  the  resulting  integral  has  a  simple  analytical  form, 
too.  We  will  return  to  this  case  in  an  example  in  §2.3. 

Even  when  the  objective  is  not  analytically  tractable, 
NLPl  can  be  solved  with  relative  ease  when  D  is  determin¬ 
istic  because  the  objective  is  a  sum  of  one-dimensional  ex¬ 
pectations.  For  example.  Kail  et  al.  (1988)  solve  problems 
such  as  NLPl  by  applying  sequential-approximation  meth¬ 
ods  with  the  bounds  of  Jensen  and  Edmundson-Madansky. 
(The  dimensional  limitations  of  the  E-M  bound  are  not 
a  factor  in  this  combined  technique  because  the  bound  is 
applied  to  one-dimensional  expectations.)  This  method 
creates  a  sequenee  of  discrete  approximations  to  the  contin¬ 
uous  problem,  each  of  which  can  be  formulated  and  solved 
as  described  in  §1.3.1.  Wets  (1983)  discusses  warm-start 
procedures  for  efficiently  solving  this  sequence  of  approxi¬ 
mations. 

1.4.  An  Example 

For  illustrative  purposes,  we  apply  the  bound  of  Theorem  1 
to  the  stochastic  maximum-flow  (SMF)  problem  (e.g.,  Evans 
1976).  For  this  problem,  D  is  deterministic  and  only  part 
of  d  is  random.  Let  G  =  {N,  A)  he  &  directed  graph  where 
N  is  the  set  of  nodes  and  A  is  the  set  of  arcs.  (See  Ahuja 
et  al.  1993  for  more  detailed  definitions  on  network  flows.) 
Arc  k  =  (i,  j)  is  directed  from  node  i  to  node  j,  and  A 
includes  an  artificial  “return  arc”  A  =  id,  s)  that  connects 
the  “sink  node”  t  to  the  “source  node”  s.  Let  FSii)  (“forward 
star  of  /”)  and  RSii)  (“reverse  star  of  /”)  denote  all  arcs 
directed  out  of  node  i  and  into  node  i,  respectively.  Eaeh 
arc  k,  except  A,  has  a  random  capaeity  Uk^O,  which  is 
an  upper  boimd  on  arc  flow  yt;  yko  is  unconstrained.  We 
wish  to  calculate  the  expected  value  of  the  maximum  flow 
through  the  network  between  s  and  t.  Restated,  the  problem 
is  to  find  Ehoiu)  where 

RFO(SMF)  /!o(u)  =  max  yk„ 
y 

s.t.  ^  yic-  ^  yk=0  V/GA,  (1) 

keFS(i)  keRS(i) 

yk^Uk  ykGA-ko, 

(2) 

yk^O  Wk  £  A  —  ko- 

(3) 

The  function  hoiu)  is  concave  and  hence,  the  Jensen  upper 
boimd  for  the  SMF  problem  is  simply  h'^  =  hoia)  where 
u  =  Au.  We  now  describe  our  new  lower  bound,  and  begin 
by  stating  the  relevant  variant  of  Theorem  1 : 


E 

max 

yer 

fy 

=  E 

max  fy  —  7i"(y  —  u)^ 

s.t. 

y  :  7i(ii) 

_yer 

^maxfy-7r"A[(y-u)+], 

yer 


provided  n”  ^  7i*(u),  wp\.  Here,  y  G  T  represents  constraints 
(1)  and  (3). 
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In  order  to  compute  the  lower  bound  h'^,  for  the  SMF 
problem,  we  require  upper  bounds  on  the  dual  variables 
for  the  arc  capacity  constraints.  Since  the  maximum  flow 
in  a  network  can  be  increased  by  at  most  one  unit  with 
the  increase  in  the  capacity  of  an  arc  by  one  unit,  the  dual 
variable  associated  with  each  constraint  of  type  (2)  is  at 
most  1 .  Thus,  the  following  recourse  function  has  the  same 
value  as  ho(u)  for  any  realization  of  ii: 

h0>ia)  =mcix  yk„  -  {yk  -  UkV 
y>o 

kGA-ko 

s.t.  ^  yk-  ^  yk  =  0  Wi  GN. 
keFS(i)  keRS(i) 

The  lower  bound  on  Eho(u)  is  therefore  obtained  by  solving 
NLPl(SMF)  /z^=max>>i„—  —  Mt)+] 

y>o 

kGA-ko 

s.t.  yk-^  Ti  =  o  v/eA^. 
k&FS(i)  keRS(i) 

If  the  random  variables  Uk  are  discrete,  NLPl(SMF) 
becomes  a  linear  program  whose  objective  function  is 
piecewise-linear  and  concave  in  y.  In  §3  we  compute  bounds 
for  problems  with  discretely  distributed  random  variables, 
but  at  this  point  it  is  more  revealing  to  investigate  two 
simple  “limiting  problems”  where  the  Uk  are  continuously 
distributed.  We  compare  the  quality  of  the  new  lower  bound 
with  the  Jensen  upper  bound  for  these  problems. 

Let  the  arc  capacities  Uk  for  an  SMF  problem  be  uniform 
random  variables  on  [0,  m^'].  Then, 

E’rr  ~  ^+^  yk-^k  ,  yl 

E\iyk  -Uk)]=  duk  = 

Jo  ^k  ^^k 

Therefore,  computing  h'g,  will  involve  solving  a  separable 
quadratic  programming  problem.  Next,  suppose  that  G  con¬ 
sists  of  n  arcs  in  parallel  between  s  and  t  (plus  the  return 
arc)  and  the  capacities  are  i.i.d.  imiform  random  variables 
on  [0,  m"].  Let  h{n)  denote  the  true  expected  maximum  flow 
for  n  arcs,  let  /zo(«)  denote  the  corresponding  Jensen  up¬ 
per  bound,  and  let  /?^(«)  denote  the  new  lower  bound.  The 
Jensen  upper  boimd  is  exact,  i.e.,  /2o(«)  =  h{n)  —  nu" jl, 
because  there  is  only  one  cut  in  the  network  and  its  average 
capacity  equals  the  average  (expected)  maximum  flow.  The 
lower  boimd  h'^{n)  can  be  computed  by  noting  that  the  flow 
yk  on  each  arc  k  must  be  the  same  at  optimality,  say  y,  and 
the  total  flow  will  be  ny.  Thus, 

t'  r  \  y^  nu 

«#(«)  =  max  ny  -  n—  =  — , 

2u"  2 


be  the  expected  value  of  the  minimum  of  a  set  of  i.i.d. 
uniform  random  variables.  This  value  is  h(n)  =  u''/{n  4-1). 
In  contrast,  the  Jensen  upper  bound  is  hQ{n)  =  u" jl  so 
that  lim^^oo  hQ(n)lh(n)  =  oo.  The  lower  bound  may  be 
obtained  by  modifying  the  derivation  for  the  parallel  case, 
noting  that  the  flow  on  any  arc  equals  the  total  flow.  Thus, 


h'g,{n)  =  max  y  -  n  — 
2u" 


u 

2n 


This  bound  is  not  tight,  but /!^(«)/A(«)^  1/2  for  any  «  >  0, 
and  hence  it  does  not  become  arbitrarily  poor  for  increasing 
n  as  does  the  Jensen  bound. 

Before  leaving  this  example,  we  illustrate  how  the  primal 
restricted-recourse  bound  can  be  tightened  if  better  bounds 
on  dual  variables  are  available.  The  following  proposition 
is  a  simple  extension  of  Theorem  1 . 


Proposition  1.  Suppose  that  hounds  on  optimal  dual  vari¬ 
ables  n*(^)  are  available  in  RFO  as  a  function  of  the 
parameters!^,  i.e.,  7i"(|)^7i*(|),  wpl.  Then, 

EholO  ^  min  [£f]y  -F  E[n''CO{A  -  .Dy)+]. 
yer 


For  NLPl(SMF),  the  corresponding  functional  dual 
bound  is  denoted  7r"(u)  and  the  bounding  problem  can  be 
revised  to 

NLP2(SMF)  /;^=maxyi„—  E\n" {n){yk—UkY'\ 

y  >0 

k^A-kQ 

S.t.  ^  yk-  ^  V/GTV. 

k^FS{i)  k^RS{i) 


We  can  exploit  NLP2(SMF)  easily  in  the  series-network 
example  by  noting  that  an  optimal  dual  tt/  in  this  problem 
is  1  if  Uk  is  a  limiting  capacity  in  the  network  and  is  0 
otherwise.  So,  define 

_  /  1  if  dk>  ^Uk  , 

^  ~  1 0  ofherwise; 

suppose  fhaf  the  Uk^O  are  continuous  and  i.i.d.,  and  let 
Mmin  =  min^  Uk.  Then,  a  revised  bound  for  this  example  is 


n 

h'^{n)  =  max  y  -  V£[7t/'(u)(y  -  Uk)A 

v^O 

k=\ 

=  max y  -  «£'[7tj'(ii)(y  -ui)+\ui=  P[ui  = 

y  >0 

=  max  y  -  E[(y  -  Wmin)^] 

y  >0 

—  Fil 


which  is  exact  like  the  Jensen  bound.  (Because  the  recourse 
function  is  linear  in  the  arc  capacities,  exact  Jensen  and 
restricted-recourse  bounds  are  actually  obtained  for  any  ran¬ 
dom  capacities  with  finite  means;  neither  the  identical  nor 
independent  hypothesis  is  actually  required.) 

Next,  suppose  that  G  consists  of  the  same  n  arcs  placed 
in  series  between  s  and  t.  The  average  maximum  flow  will 


This  is  the  exact  solution  to  this  problem;  we  have  success¬ 
fully  tightened  the  restricted-recourse  bound.  If  the  random 
arc  capacities  have  unbounded  support,  the  above  optimiza¬ 
tion  must  be  interpreted  as  the  greatest  lower  bound  (i.e., 
supremum)  instead  of  a  maximization.  Similarly,  when  nec¬ 
essary,  the  optimization  in  Proposition  1  and  Theorem  1 
should  be  interpreted  as  the  least  upper  bound,  i.e.,  “min” 
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is  replaced  with  “inf.”  (This  issue  does  not  arise  when  Y  is 
compact,  which  may  be  assumed,  without  loss  of  generality, 
for  finite- valued  recourse  functions  whose  random  parame¬ 
ters  have  bounded  support.) 

In  this  example,  the  7t^'(ii)  are  optimal  dual  variables,  not 
just  bounds  on  optimal  dual  variables.  We  do  not  suggest  that 
it  will  normally  be  possible  to  obtain  optimal  dual  variables 
as  a  function  of  the  random  parameters  and  thereby  find 
the  exact  solution  to  a  stochastic  programming  problem. 
However,  by  using  dual  bounds  that  are  functions  of  some 
of  the  random  variables  in  the  problem,  it  may  be  possible 
to  improve  the  quality  of  a  restricted-recourse  boimd. 


2.  DUAL  RESTRICTED-RECOURSE  BOUND 

The  problem  addressed  here  is  to  compute  a  lower  bound 
on  Eho(^),  where 

RFO  hQ(^)  =  min  fy 

O^y^u 

s.t.  Dy  ^  d. 

The  resulting  bound  will  be  complementary  to  the  bound 
developed  in  §1.  Recall  that  the  primal  restricted-recourse 
bound  requires  dual  bounds  but  only  for  con¬ 

straints  that  contain  stochastic  parameters.  Similarly,  the 
dual  restricted-recourse  bound  developed  in  this  section  re¬ 
quires  simple  boimds  on  y  (or  on  y*(|),  an  optimal  solution) 
but  only  for  columns  of  RFO  that  contain  stochastic  parame¬ 
ters.  Analogous  to  the  discussion  at  the  end  of  §  1 .4,  we  may 
tighten  the  dual  restricted-recourse  bound  by  using  bounds 
on  y  of  the  form  u(|);  this  is  illustrated  in  §3.  For  nota- 
tional  simplicity  in  this  section,  we  assume  that  all  columns 
of  RFO  have  stochastic  parameters  and  that  each  yj  has  a 
deterministic  simple  upper  bound,  i.e.,  yj  ^  Uj  for  all  j. 

2.1.  The  Dual  Bound 

Theorem  2.  Let  ^  =  vec(d,  f,.D).  Then,  h'^  ^EhQ(^),  where 

n 

NLP2  h^  =  maxTtf^d]  —  ^  UjE\(yiib.j  —  ^)^]. 

71^0 

Proof.  By  taking  the  dual  of  RFO  and  applying  Lemma  2, 
we  may  re-express  /!o(l)  as 

^o(l)  =  max  Tid  —  hu 

71^0, /I  JsO 

n 

=  max  Tid  —  >  uAnb.j—f:b 
n^o  ^  ^  ^  J 

y=i 

s.t.  — 

By  applying  a  restriction,  i.e.,  the  “max”  variant  of  Lemma 
1 ,  we  obtain 

n 

Ehoi^)^  maxTifisd]  -  'V'  UiE\{nb.j  -  /)+]  =  h'^.  □ 

TT^O 

7=1 


As  in  §1,  convexity  of  ho(^)  is  not  required  to  obtain  the 
lower  bound  in  Theorem  2.  Naturally,  sharp  bounds  u  on 
y*(|)  will  yield  tighter  lower  bounds  on  Eho(^)  and,  as  with 
the  primal  bound,  computing  h'^  is  equivalent  to  solving  a 
stochastic  program  with  simple  recourse.  Models  that  allow 
efficient  computation  of  the  boimds  are  discussed  next. 


2.2.  Models  for  Computation 

2.2.1.  Discrete  Random  Variables.  When  D  and  f  are  dis¬ 
crete  random  variables  that  take  on  a  finite  number  of  values. 
NLP2  can  be  solved  as  a  linear  program.  Note  that  the  bound 
from  Theorem  2  depends  on  d  only  through  its  mean.  Let 
realizations  of  the  yth  column  vector  (fj,  D.j)  be  denoted 
{fj',  D’'.j)  where  r  G  Rj,  and  let  the  corresponding  proba¬ 
bility  mass  function  be  denoted  P[(  fj,  D  j)  =  (  fJ',  Df^)]  = 
p''j.  With  this  notation,  NLP2  may  be  written  as 


max  n[EA'\  —  R/W/Z/ 

Tt^O.zSsO 


7=1  r£Ri 


(4) 


s.t.  7tL»c  j  =  \,...,n,  r  G  Rj. 


Taking  the  dual  of  (4)  yields  the  following  primal  formu¬ 
lation: 


max 

y3>o 


Y.Y,fIyj 

7=1  r(^Ri 


s-t- 

7=1  rdRi 

yj^p'j^j’  J  =  n,  r  G  Rj. 


(5) 


In  the  case  of  a  two-stage  stochastic  LP,  Ed  would  simply 
be  replaced  by  Ed  +  [F'.SJx,  and  the  minimization  would  be 
taken  over  x  and  y. 

The  number  of  structural  constraints  in  (5)  does  not  de¬ 
pend  on  the  number  of  realizations,  and  the  number  of  deci¬ 
sion  variables  is  J2j=i  1^7 1-  While  this  value  may  be  large, 
it  is  typically  much  smaller  than  0/=!  1^7 1 >  which  deter¬ 
mines  the  size  of  the  deterministic  equivalent  for  the  original 
problem  SLP-2.  When  the  number  of  stochastic  parameters 
per  column  is  modest,  computing  the  bound  via  (5)  will  be 
practical.  For  example,  if  the  recourse  problem  involves  op¬ 
timization  over  a  typical  generalized  network,  |Ryj  would 
be  at  most  2,  corresponding  to  stochastic  cost  and  gain  (or 
loss)  coefficients. 

When  D  is  deterministic,  the  size  of  the  model  depends 
only  on  the  number  of  realizations  in  the  marginal  distribu¬ 
tions  of  fj.  The  form  of  the  bounding  program  (5)  does  not 
change,  except  that  becomes  D.j.  When  both  D  and  f 
are  deterministic,  it  is  clear  from  (5)  that  the  proposed  lower 
bound  is  equivalent  to  Jensen’s  bound  for  a  stochastic  LP 
with  a  random  right-hand  side. 


2.2.2.  Continuous  Random  Variables.  When  D  is  determin¬ 
istic  but  f  is  continuous,  computing  the  lower  bound  directly 
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from  the  NLP2  formulation  is  possible  because  it  involves 
only  one-dimensional  integrals.  The  remarks  from  §1.3.2  re¬ 
garding  analytically  available  nonlinear  objective  functions 
and  the  use  of  boimding  and  approximation  techniques  are 
also  relevant  here.  In  the  next  section,  we  give  an  example 
where  the  random  cost  coefficients  are  exponential  random 
variables. 

2.3.  Example 

A  simple  example  to  which  the  above  technique  may  be 
applied  is  the  stochastic  shortest-path  (SSP)  problem  (e.g., 
Frank  1969,  Mirchandani  1976).  We  are  interested  in  com¬ 
puting  the  expected  length  of  a  shortest  path  between  nodes 
s  and  t  in  a  directed  network  G  where  the  length  (e.g.,  time, 
distance,  or  cost)  of  each  arc  k  =  (;,  j)  is  a  random  variable 
Ck-  Assuming  that  there  are  no  negative-length  cycles  in  G, 
the  deterministic  shortest-path  problem  may  be  formulated 
as  a  network  flow  problem  that  routes  one  unit  of  flow  as 
cheaply  as  possible  from  s  to  t.  Thus,  SSP  computes  Eho(c), 
where  ho(c)  is  defined  by 

RF0(SSP )  /!o(c)  =  min  ^  Ckyk 

keA 

s.t.  yk-  yk 

keFS(i)  keRS(i) 

{1  for  i  =  s, 

0  V/gA-{5,  t}, 

—  1  for  i  =  t. 

Applying  Jensen’s  inequality  to  this  problem  yields  an  upper 
bound  Hq  =  ho(c).  In  order  to  derive  our  complementary 
lower  boimd  we  take  the  dual  of  the  shortest  path  problem: 

RF0(SSP,  dual)  ho(c)  =  max  —  %t 

n 

s.t.  Tli  —  Tlj  ^  Ck 

=  {i,  j)  G  A. 

Using  the  fact  that  ^  1,  the  bound  may  be  stated: 

=  max  (Us  —  n,)  —  ^  E{ni  —  Uj  —  Ck)^ .  (6) 

k=(i,j)eA 

We  illustrate  this  bound  with  an  example  in  which  the 
nonlinear  terms  in  the  objective  of  (6)  may  be  integrated 
analytically.  Suppose  that  each  arc  k  has  length  that  is 
distributed  as  an  exponential  random  variable  with  rate  Ik, 
i.e.,  Fk(c)  =  1  —  for  c^O.  In  this  case,  the  nonlinear 
objective  terms  become 


For  an  SSP  with  exponential  arc  lengths,  we  may  bound 
the  optimal  objective  from  below  by  solving  the  uncon¬ 
strained  optimization  problem  given  by  (6)  and  (7).  We 
investigate  two  limiting  cases  here  to  compare  the  accuracy 
of  the  new  lower  bound  to  the  complementary  Jensen  bound. 

Suppose  that  G  consists  of  n  arcs,  arranged  in  paral¬ 
lel,  with  lengths  that  are  i.i.d.  exponential  random  variables 
with  common  rate  1.  Let  h{n)  denote  this  network’s  ex¬ 
pected  shortest  path  length.  This  is  just  the  expected  value 
of  the  minimum  of  n  i.i.d.  exponential  random  variables, 
so  h{n)  =  link.  The  Jensen  upper  bound,  denoted  h^^n), 
is  the  expected  length  of  any  arc,  so  /jo(«)  =  1/2  and 
lim„^oo  Zjo(«)/^(«)  =  oo;  i.e.,  the  bound  becomes  arbi¬ 
trarily  poor  as  n  increases. 

The  dual  restricted-recourse  bound  for  this  problem,  de¬ 
noted  h'^{n),  is  better.  Defining  y  —  its  —  n,,  the  objective 
of  the  bounding  problem  may  be  written  as 


y  —  n 


y+\e 


-ky 


1 

J 


(8) 


Minimization  of  this  function  through  calculus  yields 

= J + ('“O’ 


It  is  easy  to  show  that  h'^(n)lh(ri)  =  1/2.  Thus 

the  bound  is  not  tight,  but  it  does  not  become  worthless 
for  large  values  of  n.  The  structure  of  the  dual  formulation 
of  this  problem  is  identical  to  the  series  SMF  problem  of 
§1.4  so  that  the  same  technique  may  be  used  to  obtain  an 
exact  bound.  In  particular,  this  result  is  achieved  using  the 
functional  primal  bounds 


Uk(y) 


1  if  Ck'^Ck'^k' , 

0  otherwise. 


Finally,  suppose  that  G  consists  of  n  arcs  in  series  where 
the  arc  lengths  are  random  variables.  The  true  expected 
shortest  path  length  is  the  expectation  of  a  sum  of  n  random 
variables,  so  h{n)  =  E^j^^^Ck  —  njl.  The  Jensen  upper 
boimd  is  just  the  sum  of  the  individual  expectations,  so  it  is 
exact. 

To  compute  our  bound,  we  begin  with  the  dual  for¬ 
mulation.  Because  of  the  series  structure  of  the  network, 
the  inequalities  in  the  dual  must  hold  with  equality.  With 
y  =  Us  —  n,,  the  dual  recourse  function  reduces  to 


max  y 

y 

s.t. 

kGA 


E 

kHiJKA  ' 


{Ui  —  Tlj  —  c)Xke^‘‘‘^  dc 


=  E 

k=(i,j)eA 


Tlj)  +  ^exp[-2i:(7t,' 
Ak 


%)] 


(7) 


This  leads  to  the  bound  h'^{n)  =  E  ^keA  —  njX,  and  thus 
the  restricted-recourse  lower  bound  is  also  exact. 


3.  A  COMPUTATIONAL  EXAMPLE 

This  section  describes  a  pilot  model  for  capacity  expansion 
in  the  semiconductor  manufacturing  industry  and  then  uses 
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the  model  to  demonstrate  the  formulation  and  computation 
of  restricted-recourse  bounds.  This  model  is  an  extension  of 
Stafford  (1997). 

In  this  strategic  model,  budget-constrained  purchases  of 
semiconductor  wafer-fabrication  machines  are  made  in  the 
first  stage  so  that  imcertain  demands  for  wafers  of  various 
types  and  quantities  can  be  met  in  the  second  stage  as  best 
possible.  Demand  distributions  cover  demands  over  a  one- 
month  period,  starting  about  one  year  in  the  future — one 
year  being  the  approximate  lead  time  for  delivery  and  set-up 
of  the  fabrication  machines.  Because  of  this  long  lead  time, 
there  is  significant  uncertainty  in  what  the  actual  demands 
will  be. 

Production  of  a  wafer  requires  multiple  steps  in  a  speci¬ 
fied  order,  although  a  single  machine  may  be  able  to  perform 
more  than  one  step.  Because  the  model  is  strategic,  how¬ 
ever,  it  does  not  schedule  wafer  production  per  se.  Rather, 
it  determines  production  quantities,  ensures  that  the  total 
number  of  steps  of  each  type  is  sufficient  to  meet  production 
quantities,  and  ensures  that  the  total  time  required  to  per¬ 
form  the  assigned  steps  does  not  exceed  available  machine 
time. 

Because  demands  are  aggregates  over  the  period  of  a 
month,  and  because  there  is  a  wealth  of  experience  with 
most  of  the  machine  types,  the  model  assumes  that  the 
availability  of  the  machines  is  deterministic.  That  is,  the 
number  of  actual  production  hours  available  on  each  ma¬ 
chine  (accounting  for  down-time  for  maintenance  and  re¬ 
pair)  is  assumed  known.  On  the  other  hand,  because  some 
of  the  wafer  types  that  the  machines  will  be  producing 
are  new,  there  is  imcertainty  in  the  processing  time  that 
the  steps  will  require.  Therefore,  the  second  stage  of  the 
model  incorporates  imcertainty  in  production  rates  as  well  as 
demands. 

3.1.  The  Model 

The  two-stage  stochastic  mixed-integer  program  (MIP)  for 
wafer  production  (WMIP)  is  specified  below. 

Indices  and  Index  Sets 

m  G  M  Machine  types 

w  G  W  Wafer  (product)  type 

s  G  S  Process  steps 

S„CS  Process  steps  required  by  wafer  type  w 

Swm  Q  S„  Process  steps  for  wafer  w  that  can  be  performed 

on  machine  m 

Wm  Q  W  Wafers  that  may  be  processed  on  machine  m 
Msw  Q  M  Machines  that  can  perform  step  s  for  wafer  w 

Data 

Urn  Number  of  existing  machines  of  type  m 
Cm  Unit  cost  to  purchase  a  machine  of  type  m 
B  Total  budget  for  purchasing  machines 

Tm  Production  time  available  per  machine  of  type  m 
Pm  Unit  shortage  penalty  for  wafer  type  w 
tswm  Random  processing  time  for  step  s  for  w  on  m 
d„  Random  demand  for  wafer  type  w 


Decision  Variables 

Xm  Number  of  machines  of  type  m  to  purchase  (first 

stage) 

Number  of  wafers  of  type  w  to  produce  (second 
stage) 

Zswm  Number  of  steps  5  for  wafer  w  to  assign  to  ma¬ 
chine  m  (second  stage) 

v„  Unmet  demand  for  wafer  type  w  (second  stage) 

Formulation 

WMIP  z*  =  min  £/(x,  d,  f) 

X 

S.t.  ^  ^  CffiXffi 
mGM 

Xm  G  V/u  G  A/, 
where  /(x,  d,  f)  =  min  PmVm, 

V,  y,  z  ^ ^ 

welV 

S.t.  ^  ^  ^  ^  ^swm^swm  ^  ^m')  ^  A/,  (lb) 

wew„  ses„ 

^  ^  ^swm  Tw  ^  b  Vw  €  JVy  S  G  (11) 

inGMim 

yw  +  Vw>d„  Vw  G  W,  (12) 

y„,  v„  ^  0  Vw  e  IT, 

^swtn  ^  b  \/w  G  IT,  s  G  *5,1?,  iyi  G  A/^,y. 

Constraint  (9)  is  the  first-stage  budget  constraint.  Second- 
stage  constraints  limit  the  processing  time  on  machines 
to  time  available  (lb),  ensure  that  processing  steps  are 
assigned  to  meet  production  quantities  (11),  and  meet  de¬ 
mand  elastically  (12).  First-stage  variables  are  required  to 
be  integral  because  the  number  of  machines  to  be  purchased 
is  small,  about  six.  Second-stage  variables  are  continuous 
because  the  number  of  wafers  being  produced  is  large,  in 
the  hundreds.  We  note  that  WMIP  is  similar  in  structure 
to  a  production  model  developed  by  Higle  and  Sen  (1994), 
except  that  their  model  does  not  involve  separate  process 
steps  on  different  machines. 

3.2.  Restricted-Recourse  Bounds  for  WMIP 

For  the  purpose  of  stating  the  restricted-recourse  bounding 
models,  we  need  additional  definitions  and  assumptions: 

1.  Demands,  d„,  are  discretely  distributed  with  realiza¬ 
tions  dl„  for  /  G  Z,„  =  { 1,^2, . . . ,  \L„\},  d^  =  0,  d^-'^  <  d^ 
for  /  G  L„,  and  <1)1,  =  P[d„  ^d!^]  for  /  G  L„.  In  the  primal 
bounding  model,  unmet  demand  v„  is  expanded  by  demand 
level  /  to  v[^,. 

2.  Because  Pw  is  an  explicit  elastic  penalty  on  the  demand 
constraint  (12)  indexed  by  w,  p„  is  an  upper  bound  on  the 
dual  variable  associated  with  that  constraint. 

3.  Processing  times  tswm  >  b  are  discretely  distributed 

with  realizations  ^  mass  functions  p‘ss^  = 

P[tswm  =  tl„m\  i  G  ^swm-  In  the  dual  bounding  model, 
assignment  variables  Zs„m  are  expanded  to  z(„„,  iGlswm- 
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For  the  primal  bounding  model,  we  require  Rm  = 
Ylwetv^  sample  space  for  the  vector  of  pro¬ 

cessing  times  that  corresponds  to  each  machine.  Let  p''^  = 
P[liwm  =  Cm  G  ^m,  5  G  C]  for  r  G  Rm.  In  the  primal 
bounding  model,  assignment  variables  are  expanded 
to  Cm>  r  G  Rm,  and  constraint- violation  variables  for  the 
expanded  versions  of  constraint  (10)  are  denoted  Qm- 

4.  The  dual  variables  associated  with  (10)  are  nonpositive, 
and  thus  lower  bounds  on  these  variables  are  needed  for  the 
primal  restricted-recourse  model  (see  Remark  4  in  §1.2). 
These  bounds  can  be  made  functions  of  the  realization  r 
(see  §1.4).  We  use  n'^  =  min„,g^„,  ses„„{-/>w/Cm}- 

5.  Upper  bounds  on  primal  variables  are  needed  to 
compute  the  dual  restricted-recourse  lower  boimd.  These 
bounds  can  be  made  functions  of  both  Tm(Um  +  Xm)  and 
the  realization  of  Cm  and  yield  constraints  zC  ^  C(Mm  + 
^m)/tswm- 

6.  The  restricted-recourse  bounds  are  valid  for  random 
parameters  with  general  dependency  structures.  With  respect 
to  both  the  primal  and  dual  bounding  models,  we  require 
only  the  marginal  distributions  of  the  demand  parameters. 
However,  to  calculate  the  primal  boimd  we  must  compute 
Pm,  and  hence  we  must  specify  the  structure  relating  the 
processing  times  on  each  machine.  We  will  assume  that  for 
each  m,  ts„m,  Viv  G  Wm,  s  G  S„  are  independent. 

The  model  for  the  primal  restricted-recourse  bound,  with 
first-stage  solution  denoted  is 


min 


X,  g,v,  y,z 


wGW 


E  E  ^>-3- 


S.t. 


E  E  Kswm^Rwm  Qn 


^  T^{Uni  +  Xm)  V//I  G  M,  r  G  Rm, 

^  ^  ^swm  yw  ^  0  '^W  G  S  G 

Tw  +  E  ^ 


^  ^  ^mXm  ^R, 

m^M 

Xm  G  Z+  \fm  G  M, 

Tw  ^  0  Vw  G  IT, 

VwGir, /gl, 

Qm^^  Vm  G  M,  r  G  Rm, 

Zswm  ^0  y-w  G  W,  s  G  S„,  m  G  Ms„. 


The  model  for  the  dual  restricted-recourse  bound,  with  first- 
stage  solution  denoted  xj,  is 


WMIP-^  min  pwVw 

X,  v,y,z  •  ^ 

wGW 


S.t. 


E  E  E  ^swm^swm 

W,„  iGlswm 


'y  ^  ^  ^  ^swm  ^  ^ 

yw  G  W,  s  G  Sw, 

yw  +  Vw  >Edw  V>v  G  W, 

^  ^  ^mXm  ^  R, 
m^M 

Xm  G  Z+  Vm  G  M, 
y„,,  v„  ^0  Viv  G  W, 

®  ^  ^swm  ^  Pswm  PmiUm  +  Xm  )ltgwm 
Vm  G  M,  w  G  Wm, 

S  G  Swm,  f  G  Iswm- 

3.3.  Computational  Results 

Here  we  test  the  accuracy  and  speed  of  computation  for 
the  bounds  produced  by  WMIP-^  and  WMIP-^.  We  also 
examine  the  tightness  of  the  bounds  as  the  variability  of  the 
random  processing  times  increases. 

The  test  scenario  has  27  machine  types  (only  a  subset  of 
all  types  will  be  purchased),  10  wafer  types,  up  to  7  produc¬ 
tions  steps  for  each  wafer,  6  existing  machines,  each  of  a 
different  type,  and  an  unmet  demand  penalty  of  =  1  for 
all  wafer  types  w.  The  budget  B  and  costs  Cm  allow  for  the 
purchase  of  six  machines.  For  all  wafer  types  w,  demands 
have  realizations  G  {50  -1-25/,  /  =  1,...,  5}  (monthly 
data  have  been  scaled  to  units  for  a  single  day),  with  mass 
function  P\d„  =  d[,'\  =  p‘„  =  0.1,  0.2 .0.4,  0.2,  0.1  for  /  = 
1,...,  5,  respectively.  Available  time  is  Tm  =  800  minutes 
for  each  machine.  Mean  processing  times  Etswm  range  be¬ 
tween  2  and  9  minutes,  and  is  a  binary  random  variable 
with  equal  probability  of  taking  on  either  value.  Specifically, 
the  realizations  are  (1  —  a.)Etswm  and  (1  -f  (x)Etswm,  where 
a  is  a  parameter  that  will  be  varied  to  test  sensitivity  of  the 
bounds  to  the  variability  of  these  random  parameters.  Our 
data  and  formulation  limit  us  to  handling  two  or  three  re¬ 
alizations  of  each  processing  time  because  of  the  exponen¬ 
tial  expansion  required  in  the  structural  constraints  indexed 
by  Rm  in  the  primal  bounding  model.  WMIP  has  a  total  of 
I  ^1  +  J2weiv  ~  10  -h  52  =  62  random  parameters,  and 
under  the  assumption  that  the  random  parameters  are  inde¬ 
pendent  (one  probability  model  for  which  the  bounds  are 
valid),  has  5''^  •  2^^  total  scenarios. 

All  testing  is  performed  on  an  IBM  RS-6000  Model  590 
computer  with  512  megabytes  of  RAM.  Models  are  gener¬ 
ated  using  GAMS  (Brooke  et  al.  1992)  and  solved  using  the 
OSL  (1993)  mixed-integer  solver.  WMIP-^  has  1152  vari¬ 
ables  and  1292  structural  constraints  while  WMIP-iZ  has 
325  variables  and  282  structural  constraints.  All  MIPS  are 
solved  to  within  an  absolute  tolerance  of  0. 1  units,  which  is 
accounted  for  in  the  reported  results. 

Table  1  lists  computational  results  with  six  different  values 
of  a.  The  table  lists  the  following  values: 


4”  Xm^  y^Yl  G  Tf, 


1.  The  value  of  a. 
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Table  1.  Computational  results  for  WMIP-^  and  WMIP-^. 


a 

Lower  bounds 

WLP-^  WMIP-® 

Upper  bounds 

WMIP-®  WMIPf-®  MC 

Solution  Secs. 

WMIP-®  WMIP-®  WMIPf® 

0.00 

114.63 

168.11 

233.99 

233.99 

179.27(4.69) 

8.19 

46.95 

2.10 

0.05 

76.33 

127.51 

263.28 

263.28 

173.30(4.70) 

6.09 

62.40 

3.33 

0.10 

34.24 

86.57 

292.43 

292.43 

171.35(4.39) 

6.38 

58.98 

3.58 

0.15 

0.00 

43.88 

320.73 

320.73 

162.68(4.42) 

2.08 

60.61 

3.75 

0.20 

0.00 

0.00 

346.95 

376.29 

158.64(4.41) 

0.53 

56.56 

3.09 

0.25 

0.00 

0.00 

371.99 

380.76 

152.67(4.86) 

0.20 

47.13 

2.91 

WMIP-S> 

WMIPf-^ 

WLP-® 

MC 


Dual  lower-bounding  model. 

Primal  upper-bounding  model. 

Primal  upper-bounding  model  with  x  fixed  to  xj. 

LP  relaxation  of  WMIP-i^. 

Monte  Carlo  model:  upper  bound  (std.  dev.)  for  WMIP  with  x  =  xj, 


2.  The  lower  bound  provided  by  the  LP  relaxation  of 
WMIP-^.  (A  valid  lower  bound  for  WMIP  is  ob¬ 
tained  by  solving  any  relaxation  of  WMIP-^.) 

3.  The  lower  bound  provided  by  solving  WMIP-^  (with 
integer  restrictions). 

4.  The  upper  bound  provided  by  solving  WMIP-^. 

5.  The  upper  bound  provided  by  solving  WMIP-^  with 
X  fixed  at  xj,  the  solution  derived  from  WMIP-^. 
(A  valid  upper  bound  on  z*  is  obtained  by  solving  any 
restriction  of  WMIP-£^.) 

6.  A  crude  Monte  Carlo  estimate  of  an  upper  bound  on 
z*,  with  X  fixed  at  x  j,.  This  is  computed  by  solving  the 
second-stage  recourse  problem  from  WMIP  (with  x  = 
xj,)  for  200  independent  and  identically  distributed 
observations  of  the  vector  of  random  parameters.  For 
this  calculation  we  assume  that  the  entire  collection 
of  random  demands  and  processing  times  are  mutually 
independent. 

7.  The  solution  time  for  the  dual  bounding  model 
WMIP-^.  (We  do  not  make  the  obvious  simplifica¬ 
tions  of  either  model  when  a  =  0,  i.e.,  when  the 

are  constants.) 

8.  The  solution  time  for  the  primal  bounding  model 

WMIP-'^a. 

9.  The  solution  time  for  the  primal  bounding  model 
WMIP-^  with  X  fixed  at  x|,. 

Table  1  demonstrates  a  number  of  issues  regarding  this 
application  of  restricted-recourse  bounds.  Both  the  primal 
upper-bounding  model  WMIP-^  and  the  dual  lower- 
bounding  model  WMIP-^  are  relatively  easy  to  solve;  see 
the  first  two  columns  of  solution  times.  Of  the  two  models, 
WMIP-£3^  is  larger  and  more  difficult  to  solve  because  of 
the  constraints  indexed  by  R^- 

We  note  that  the  solution  to  the  LP  relaxation  of 
WMIP-^  does  not  provide  a  very  tight  bound  on  the  op¬ 
timal  solution  value  (see  the  lower  bounds  from  WLP-^ 
and  WMIP-^),  so  we  cannot  expect  to  use  this  easier- 
to-compute  lower  bound  directly.  This  also  means  that 
optimally  solving  WMIP-^  or  WMIP-£^  with  a  branch- 
and-boimd  algorithm  is  likely  to  become  more  difficult  as 


the  size  of  the  feasible  set  of  first-stage  solutions  increases. 
For  instance,  when  the  budget  allows  the  purchase  of  nine 
machines  and  Um  =  3,  solution  times  increase  by  a 
factor  of  about  200%. 

Rather  than  solving  WMIP-^  exactly  to  compute  an  up¬ 
per  bound  on  z*,  a  bound  can  be  obtained  by  solving  a  re¬ 
striction  of  WMIP-^.  Fixing  x  to  an  estimate  of  x*  yields 
an  easier-to-solve  LP.  One  obvious  estimate  of  x*  is  xj 
because  it  is  feasible  and  relatively  easy  to  compute.  The 
upper  bounds  obtained  using  this  estimate  are  listed  under 
WMIPf-^  in  the  table.  For  our  test  scenario,  x|,  is  an  op¬ 
timal  solution  to  WMIP-^  for  a  =  0,  0.05,  0.10,  0.15.  The 
lower  bounding  model  is  not  very  informative  for  a  =  0.20 
and  a  =  0.25  and  this  hints  that  x^  may  not  be  a  very  good 
estimate  of  x*.  In  fact,  the  bound  derived  from  WMIPf-^ 
does  deteriorafe  somewhat  relative  to  WMIP-^  for  these 
values  of  a. 

Clearly,  the  primal  and  dual  bounding  models  do  not 
yield  sufficiently  tight  bounds  to  be  useful  as  a  stand¬ 
alone  solution  technique  for  WMIP.  Flowever,  this  is 
understandable.  First,  z*  is  a  relatively  high-dimensional 
expectation  (with  62  random  parameters),  and  it  would  be 
surprising  if  a  deterministic  bounding  technique  yielded 
tight  bounds.  Second,  except  for  the  machine-wise  in¬ 
dependence  assumption  on  tswm,  Vw  S  Wm,  s  G  S„, 
the  numerical  values  from  Table  1  are  valid  for  a  wide 
range  of  dependency  sfructures  on  fhe  random  parame¬ 
ters;  because  of  this,  we  cannot  expect  particularly  tight 
boimds.  Furthermore,  we  envision  the  primal  and  dual 
boimds  being  applied  like  other  bounds  within  sequential- 
approximation  procedures.  The  gaps  in  the  bounds  of 
Table  1  are  reasonably  consistent  with  the  initial  gaps — 
prior  to  refining  the  bounds  by  applying  them  in  a  con¬ 
ditional  fashion — found  in  the  computational  work  of 
Edirisinghe  and  You  (1996),  Edirisinghe  and  Ziemba 
(1996),  and  Frauendorfer  (1992). 

4.  CONCLUSIONS 

This  paper  has  developed  primal  and  dual  versions  of  a 
restricted-recourse  boimd  for  bounding  the  expected  value 
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of  a  stochastic  recourse  function  that  evaluates  a  linear  pro¬ 
gram  with  random  coefihcients.  We  show  that  any  such 
recourse  function  can  be  written  as  an  equivalent  function 
with  random  coefficients  appearing  only  in  the  objective 
function  of  a  primal  or  dual  reformulation  of  the  problem. 
Taking  the  expectation  of  the  reformulation  and  then  ex¬ 
changing  the  order  of  expectation  and  optimization  yields  the 
bound. 

When  only  the  objective  function  or  right-hand  side  of  the 
original  recourse  function  is  random,  one  of  our  bounds  is 
equivalent  to  the  Jensen  boimd,  and  our  other  boimd  is  com¬ 
plementary.  So,  restricted  recourse  provides  an  alternative  to 
standard  bounds  (e.g.,  Edmimdson-Madansky,  piecewise- 
linear)  for  obtaining  a  complementary  bound.  However, 
restricted-recourse  boimds  can  be  applied  when  the  Jensen 
bounds  and  other  bounds  that  exploit  convexity  cannot  be 
employed  (or  become  computationaly  prohibitive).  Such  is 
the  case  when  random  coefficients  appear  in  some  combi¬ 
nation  of  the  right-hand  side,  objective  function,  and  con¬ 
straint  matrix.  Significantly,  restricted  recourse  can  be  used 
to  obtain  both  lower  and  upper  bounds  for  such  problems 
by  operating  on  both  primal  and  dual  reformulations  of  the 
recourse  problem. 

Computing  a  restricted-recourse  bound  is  equivalent  to 
solving  a  stochastic  program  with  simple  recourse.  For 
continuous  distributions  of  the  random  coefficients,  the 
bounding  models  are  convex  nonlinear  programming  prob¬ 
lems.  When  distributions  are  discrete,  the  models  are  LPs 
with  piecewise-linear  objective  functions.  Limiting  exam¬ 
ples  show  that  the  new  bounds  can  be  tighter  than  com¬ 
plementary  Jensen  bounds,  and  applying  the  bounds  to  a 
semiconductor  manufacturing  model  demonstrates  that  the 
bounds  can  be  computed  with  modest  effort. 

There  are  many  avenues  open  for  utilizing,  refining,  and 
exf ending  fhe  fechniques  described  in  this  paper.  We  have 
already  successfully  employed  fhe  boimds  in  a  sequential- 
approximation  algorithm  for  stochastic  network-interdiction 
problems,  but  further  work  is  necessary  to  solve  larger  and 
more  general  problems,  ft  is  clear  that  primal  restricted- 
recourse  bounds  can  be  used  with  recourse  functions 
modeled  as  elastic  integer  programs,  but  the  quality  and 
computational  efficiency  of  such  bounds  remains  unfesfed. 
Also,  addifional  research  will  be  needed  in  order  to  more  ef¬ 
fectively  employ  our  bounds  for  general  (non-network)  LP 
recourse  functions:  Optimal  primal  and  dual  variables  must 
be  bounded  to  use  restricted  recourse,  and  good  bounds  for 
general  models  may  be  difficult  to  obtain. 
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